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TWO TYPES OF counsel ING PROGRAMS WERE CuMPARtU BY RANDOM 
assignment OF 30 COUNSELORS TO TWO PRACTICUM TREATMENTS. 
FtPTEEN CCUNSELL'Kb RECEIVED 60 HOURS OF COUNSELING EXPERIENCE 
CONCENTRATED INTO THE LAST 3 MONTHS OF A YEAR-LONG TRAINING 
PROGRAM. ANOTHER 15 RECEIVED 60 HOURS DISTRIBUTED IN THE LAST 
S MONTHS. SUPERVISING STAFF AND METHODS OF INSTRUCTION WERE 

identical for botl. training outcomes of the two treatments 

WERE measured USING A SET OF RATING SCALES DEVELOPED TO 
MEASURE FIVE THEORET I CALLY RELEVANT CONSTRUCTS OF THE 
COUNSEL ING PROCESS, AS WELL AS OVERALL PERFORMANCE IN THE 
INTERVIEW. THESE SCALES WERE FOUND TO BE USABLE WITH 
INTERJUDGE RELIABILITIES OF .90. PREDICTIVE VALIDITIES FOR 
PREDICTING PRACTICUM GRADE FROM PREPRACTICUM INTERVIEWS WERE 
ABOUT .60. THESE RATING SCALES WERE USED TO EVALUATE 16MM 
SOUND MOTION PICTURE FILMS OF COUNSEL ING INTERVIEWS DONE ON 
COMPLETION OF PRACTICUM TREATMENTS BY BOTH GROUPS. ONE-WAY 
ANALYSIS OF VARIANCE TESTS ON ALL FIVE CONSTRUCTS AND OVERALL 
INTERVIEW PERFORMANCE SCORES WERE RUN FOR ALL 30 COUNSELORS. 
NO TREATMENT DIFFERENCES WERE FOUND BETWEEN GROUPS ON ANY OF 
THE variables. ANALYSIS WAS ALSO MADE OF THE NONVERBAL 
INTERVIEW BEHAVIOR OF COUNSELORS USING 17 BEHAVIOR 
CATEGORIES. TEN CATEGORIES Dl SCRI MINATED SIGNIFICANTLY 
BETWEEN HIGH- AND LOW-RATED COUNSELORS, (PS) 
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A Study of Two Types of Internships for 
Counselor Training 



The Problem 



The counseling practicum has traditionally been conducted in most counselor 
education institutions at the end of the total program of preparation. 

Generally practicum has foliow^jd the completion of most if not all of the 
required didactic course work. The assumption though seldom made explicit, 
has apparently been that a mastery of didactic material must precede practicum 
work if maximum learning in the latter is to occur. 



A number of factors suggest, however, that practicum work may profitably 
be integrated into the first phase of preparatio*i. Counselor educators frequently 
report that students have forgotten some essential elements of didactic work, and 
that time must often be taken to provide review of this material. Students in 
the beginning and intermediate phase of didactic work often fail to see the 
relationship between what they are being taught in the academic classroom and what 
they will be doing in the practicum and on the Job. 

Hany of the changes in behavior which are objectives of the practicum seem 
to be obtained as much as a function of time as in terms of the number of 
supervised interviews. Effective performance in the interview situation seems to 
be a function of the individual's ability to assimilate and integrate a considerable 
number of diverse techniques and approaches into a highly personalised and comfortable 
"counseling style" which becomes uniquely his own. It seems highly possible that 
this type of learning might occur as much as a function of time in practicum as 
xn terms of nuoiber of Interview trials. 

From a practical administrative standpoint a number of advantages exist 
in an integrated, distributed practicum. Problems of the scheduling of clients, 

interview far'’" " " -- - 

distributed | 
advantages \ 
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Related Research 

Virt-Mally oo published research has been directed to the problem of concentrated 
versus distributed practice effects within the counseling practicum* One of the 
reasons for the paucity of this type of research has been the rather primitive 
nature of research techniques and the tools available for studying the nature of 
the counseling process. 

One of the major obstacles to research in counseling has been the absence 
of generally agreed upon, operationally defined, criteria in terms of counselee 
behavior. It has been necessary to attempt to evaluate counselor behavior largely 
through an examination of the tntervie'.: process itself. 

For approximately twenty-five years various kinds of recordings of counseling 
interviews have been used to investigate the nature of the counseling process. 
Robinson (20) who has made a substantial contribution to this line of research 
calls this a study of "the social psychology of the counseling interview." He 
and others in the field have called for more thorough studies of the patterns of 
communication and interaction within the interview as the key to understanding the 
::entral dynamics which underlie both successful counseling and successful counselo-- 
preparation. 

The careful study of the counseling interview process is a vital concern in 
examining the effectiveness of counselor education procedures. The effective 
study of the interview, however, requires the availability of sizeable samples 
of total counseling behavior as these exist In interaction with real clients. 

Early studies in the area of interview process were somewhat handicapped by 
limited technicil facilities for studying counselor-client behavior. Kaufer (15), 
for example, used verbatim transcripts which included two-minute uninterrupted 
client speeches on five different questions to determine if anxiety level was 
related to speech rate or speech content. He was limited to verbal behavior 
by the nature of his approach and did not study the effects of counselor behavior 
on the client. Hoos (17) in another study analyzed tape recorded interviews for 
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nunbtr of speech units, independent of such units, end number of effective units. 

He experimented with the effects of operent conditioning techniques in influencing 
client behavior. His study was limited to verbal behavior. 

Ellsworth (9) in a more global attempt rated counselor statements within 
interviews and in case conferences. The statements were analysed on whether they 
were feeling, feeling and content, or content statements. The study Investigated 

the degree of consistency between in-intervlew and extra- Interview counselor 
behavior. 

Hoffiuan (13) approached the problem of describing counselor behavior by 
trying to analyze objectively the nature and range of counselor sub-roles. He 
analyzed the patterns of verbal behavior which the counselor uses in the interview. 
From this he developed a set of sub-roles which describe the typical repertoire 
of each counselor. Campbell (3) used Hoffman's fourteen sub-roles in analyzing 
typescripts of counseling interviews to examine the relation of counselor personality 
and background on interview behavior. 

Howe and Pope (14) investigated therapist's verbal activity level in 
Interviews. They defined activity in terms of three constructs: andsiguity, 

lead, and inference. They then classified verbal responses objectively to define 
each construct operationally. 

Davity and Davity (5) moved beyond the limits of verbal behavior to study 
the affects of non-verbal vocal cues. They rated feelings on these non-verbal 
vocal cues and found some evidence for a theory of non-verbal vocal communication. 

Buckheimer and Carter (2) studied empathic behavior by analyzing typescripts 
and recordings. Behavior was analyzed in relation to component areas of tone, 
pace, ability to grasp the client's frame of reference, adherence to or 
abandonment of counselor strategy, and repertoire of leads. 
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Sydiaha (21) used Buies' Qliteraction Process Analysis to study specific 
behavior in the interview. Dohrenwend and Richardson (7) studied the structure 
of interviews. Guze and Mensh (12) analyzed some features of the interview with 
the Interaction Chronograph. Client behaviors were analyzed as either verbal or 
non-verbal in 1/lOOth minute units of time. 

Anderson and Anderson (1), and O'Hearn and Arbuckle (18) have also reported 
studies analyzing counselor behavior. Danskiri (4), Dipboye(6), Drasgow and 
Walker (8), Fiedler (10), Grigg (11), Koester (16), and Parker (19) have all 
Reported studies which analyzed interviews in attempts to study the counseling 
process and relevant counseling behaviors. 

Most of the studies cited above dealt only with verbal communication even 
Lhough it is obvious that other types of counselor-client communication may be 
extremely relevant. Most of the studies dealt with rather broad constructs such 
as roles, empathy, content units or others which are not firmly ahehored in 
objective behaviors. Others dealt with quite specific and minute observations 
such as rate of speaking, eyeblink, etc., which are difficult to fit into a 
theoretical frame of reference. 

Design of the Study 

In the academic year 1963-64, a controlltsd experiment was designed to assess 
the differences in effectiveness between two types of practicum treatments. 
Definitions 

For the purposes of this study counseling practicum was defined as that 
portion of the counselor education program in which the trainee engages in supervised 
counseling interviews with actual clients. It is roughly analagous to practice 
teaching for teachers. Supervision was defined as (1) review and critique of 
tape-recorded interviews, and (2) observation and critique of interviews conducted 
behind a one-way vision glass. 
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The Population 

The population of subjects for this study consisted of thirty graduate 
students enrolled In the counselor education program at the University of Minnesota. 
These students were engaged In a one year program leading to certification as 
secondary school counselors. Twenty-five of these counselors were male, five were 
female. The age range was from 24 to 38 years with a median age of 27 years. All 
held bachelors degrees and all had been secondary school teachers. 

Experimental Design 
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cf the study, the total group of thirty ”as 
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divided Into two treatment groups of fifteen members each. These groups were 
known as Group A the "Distributed Practlcum Group" and Group B the "Concentrated 
Practlcum Group." Both groups received exactly the same program of didactic 
Instruction. Group A, however, received a counseling practlcum distributed over 
a six month period, while Group B received exactly the same number of hours of 
practlcum Instruction concentrated Into a three month period. Techniques of 
supervision were the same, the supervising staff was Identical for both groups, 
and every effort was made to Insure similar experiences except for the time factor. 
An elaborate schedule of practlcum activities was constructed Insuring that each 
group received a total of sixty hours of supervised work. 

Measurement of Outcomes 

The outcomes of the two practlcum treatments were studied through the use of 
16 m.nu sound motion picture films made of the actual counseling behavior of the 
counselors -In- training. Each counselor-ln- training Interviewed volunteer clients 
from the University High School as part of his regular practlcum experience. 

These Interviews were filmed with the knowledge and consent of both counselor and 
client. The motion picture camera was located behind a one-way vision mirror. 

\ Three filmed Interviews were obtained from each counselor -In- training at the 

beginning, middle and end of practlcum work. These films made the detailed analysis 
of both verbal and non-verbal aspects of the Interview possible, 
o 
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especially for this study. This Instmment was developed around five theoretical 
constructs of counselor behavior which were frequently mentioned In the counseling 
literature and which were viewed to represent most adequately the objectives of 
the counselor education program to which the thirty counselors were exposed. 

These five constructs were: 1. Role Adaptation, 2, Cognitive Flexibility, 

3. Consistency of Communication, 4. Perceptual Sensitivity, and 5. Interpersonal 
iiivolvemetif*. Thene constructs ore farther defined as follows: 

Role Adaptation . In order to meet the client's needs, the counselor is often 
called upon to play a wide variety of roles In the Interview. His success In 
using various roles depends upon several factors: (a) the number of roles In 

which he Is able to engage; (b) his ability to choose the proper role at a 
particular point In time with a particular client; and (c) his ability to shift 
roles in an efficient manner as the need arises (or, conversely, to continue In 
his present role If there Is no need to shift). 

Cognitive Flexibility . The counselor is a person to whom a client comes to 
get a fresh and different perspective about himself and his concerns. In meeting 
this need the counselor responds In diverse and creative ways which reflect his 
"cognitive flexibility." There are three aspects to this dimension: (a) the 

counselor's range of psychological concepts for understanding human behavior; 

(b) his repertory of Interview techniques within a particular role; and (c) his 
supply of relevant Information about the client and his vrorld. 

Consistency of Communication* The counselor communicates with the client in 
both verbal and non-verbal ways. He sends out "signals" to the client by means of 
(1) what he says verbally, and (2) his voice Inflection, facial expression, 
posture, gestures, and mannerisms. The counselor's "consistency of communication" 
can be ascertained by observing the degree to which his verbal and non-verbal 
behaviors are compatible, l.e., the extent to which they convey the same meaning. 
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PTC»ptuml 8«niltlvltv . Part of the couneelor'e teek la to lie tan and 
eOBprehand what the client la cowminlcatlng. Client coominlcatlona vary from overt, 
simple verbal expresslona to very subtle non-verbal communications which are 
sspressed through changes In voice <}uallty, facial expression, gestures, nervous 
mannerisms and the like. 

Interpersonal Involvement * One of the counselor's assets Is his ability to 
enter Into a close, spontaneous relationship with the client* There are two main 
n§p^cts to this dimension of counselings (a) the extent to which the counselor 
shows a genuine feeling of acceptance and caring for the client, and (b) the 
extent to %ihlch the counselor reveals himself frankly and openly as one human 
being to another* 

(jkmatructlon of the Instrument 

Rating scales of the Likert type were developed measuring each construct* 

In order to define operationally each construct In terms of counselor behaviors, 
however. It was also necessary to obtain a set of behavioral Items to undergird 
*.iie rating scale and thus to render ratings more objective* 

To do this, a universe of possibly relevant counselor behaviors was assembled 
from a variety of sources* S* pervlsor critique sheets from Interviews were 
analysed* An Intensive search of the counseling literature was made. Open-ended 
questionnaires completed by clients describing their Interview experiences were 
studied* 

Prom these sources a list of approslmately 500 Items was compiled* This list 
was then screened to eliminate Items which were duplicates or which were so highly 
Inferential In nature that they could not be objectively tallied* 

The remaining 153 items were then sorted by three experienced Ph*D. counselor 
educators in terms of their relevance to the five constructs* One hundred twenty- 
two of these Items were classified In the same way by all three of the cot iselor 
educators. These items were then used to define the five constructs defined above. 

o 
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Th« rctultlng inttruntnt appears tn Appendix A. The Judges were asked to cooplete 
both the Likert scale anC the check list of objective behaviors under lying each 
scale. Scores on the latter were termed the "yes” responses and were scored 
separately to obtain a oK>re objective neasure of the construct. 

Standardisation of the Instrument 

It was decided to use the middle set of films to refine and standardise the 
criterion instrusMnt as %rell as to train Judges. These films were viewed by three 
highly experienced counselor educators and several with lesser anK>unts of experience. 
During this process » major modifications were made in the scales which increased 
reliability. At the end of this process, it was found that the three experienced 
counselor educstors and four of the less experienced counselor educators were •ole 
tn use the scales with virtually identical results to evaluate either filmed or 
live counseling interviews. The latter four people were selected as judges for 
t 4 e remaining two sets of interviews. All of these Judges had extensive counseling 
experience and at least one year of counselor education experience. All were in 
1:11# final stages of their doctoral programs in counseling psychology. 

These judges were then given intensive training in using the final form of the 
criterion instrusMint. They were trained to rate each interview on the five selected 
constructs and also on global effectiveness using a nine point, Likert type scale* 
They were also trained to tally the counselor behaviors which underlie the constructs 

These Judges then proceeded to rate independently each of the remaining 
sixty films. Each film was rated by either two or three Judges. To check for 
various sources of rater bias, the ratings were then analysed using Guilford’s 
method. Separate analyses of variance were performed to detect three principal 
sources of errors. These were "leniency bias," "rater-trait interaction bias," 
and "halo bias." Of these only halo bias proved significant. The ratings were 
then adjusted for halo effect. 

These adjustments were found to increase inter Judge reliability to a small 
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extent. 
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ItIUbllitv of yn #truatot 

Int«rjudt« «gr#MMnt was attlaMtad by Bbal't procadura involving raliability 
by tha intraclaaa corralation. For a givan aat of data, a.g., ratings on Scala 1, 
tbia procadura yialda t%fO coafficianta of corralation- -one indicating the 
raliability of a aingla ratar, and tha othar indicating tha raliability of all 
^*tara conbinad. Tha raliabilitiaa for aach of tha acalaa, for tha cumulatad 
pointa acroaa all acalaa, and for the overall interview rating are givan in Table 1. 

raliabilitiaa are listed separately for adjusted and unadjusted ratings. On 
tha whole, tha various raliability coefficients appear quite adequate. It will 
be noted that in all cases tha reliabilities for tha adjusted ratings are higher 
than those for tha unadjusted rating. However, tha correlations for adjusted 
I stings on cuBHilatad points on scales 1-5 (with tha asterisk) should be disregarded, 
since tha method of computing the adjusted ratings insures that these correlations 
will be 1.00, except for rounding errors. 

TABLE 1 

IMTBRjaDGB AGREBHBNT (BELIABILITT) ON UNADJUSTED 
AND ADJUSTED RAT1N6S 

Scale 



1 




1 


( 


2 


4 


1 


I 


4 




5 


Cum-Pts. 


Overall 


1 1 




^ 1 


0 


A 


' U ' 


' A 


U 


; A 


1 U 


A ' 


i U 


A ’ 


' U 


1 

A 


SinglJ 

Rater 




.94 


.72 


.89 


.68 


.80 


.68 


! 

.88 


f" 

.72 


.92 


.*77 


M 

.997 


.77 


.96 


All 

Rateril 

jComb- 

jined 

t 

^ ■ 


1 

.89 
1 


.98 


.89 


.96 


a 86 


.92 


.87 1 

! 

1 1 


.96 


.89 

\ 

1 

JL_ ! 


I 

.97 

\ 

L_ 


.91 

1 


* 

.999 


.91 


.99 



^Artifact of Adjusted Ratings 

U « Unadjusted Ratings 
A ■ Adjusted Ratings 
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Intcrjudgc agrtOTMiit on tho nuabor of "Yoi" (countolor bohavlort) rotponioi 
•••Ignod for ooch tcolo and acrott tha flva acalaa la shown in Tabla 2* Thaaa 
rallabllltlaa ara tha aaaa for both adjuatad and unadjuatad ratings, alnca no 
eorractlona wara appllad to tha "Taa" rasponaaa. 



TABLE 2 

XHTBtJUDGB AGtHMBNr (RELIABILITY) ON 
NIMBBR or "YES" RESPONSES GIYEM 






12 3 4 5 Total 

on 1*5 



Single 1 

Rater | *58 

^ - 


*71 


.7* 


1 *61 


*80 


*76 


All 1 

Raters *80 

Combined 

t 


*88 

1 

1 


*90 

1 

) 

t 


1 

.82 


*92 

\ 


*90 



Validity of tha Inatruaant 

Tha concurrant validity of tha acalaa was assassad by corralatlng the scale 
ratings with three other sBaasures of counseling success which were formulated at 
tha Sana tloM tha fllma ware oiade* These ara (1) the composite ranking of the 
trainees by tha total staff, using tha criterion of "overall predicted success as 
a counselor;" (2) tha composite ranking of tha trainees on this same criterion by 
those staff naad>ars who wara Involved in assigning practlcum grades; and (3) grado 
In the practlcum* The correlations between scale ratings and each of these criteria 
ara listed In Tables 3, 4, and 5. It will be noted that tha correlations between 
Scales 1 and 2 and both sets of rankings ara significant at the .01 level, while 
those between Scale 4, cumulated points, and overall interview rating are 
significantly correlated with the same criteria at the .05 level* The correlations 
between the various scale ratings and practlcum grade are considerably lower than 
those Involving the rankings, with the exception of Scale 1, which remains 
significant at the *01 level* Scale 2 and cumulative points are still significant, 
but have dropped from the *01 to the *05 level* 



o 
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TABLE 3 

00IBBUTI0N8 BBTWBN SCALE RATDIGS 
AH) lAIKZNQ BT TOTAL 8TAFT 



12345 Cum-Pts. Overall 

UAUAUAUAUAUAUA 


Ji :,5l 


.51 


.56 


.56 


.16 


.14 


.341 .32 


.28 


.28 


.42 


.41 


.36 


.36 


•'2 


rr 

.41 


* 

.43 


** 

.47 


Mr 

.49 


.18 


.21 


.28 .32 


.31 


.33 


* 

.36 


* 

.39 


* 

.42 


* 

.45 




* 

.39 


* 

.46 


.30 

1 

1 


.34 

1 

1 


.20 


.22 


* 1 * 

.41 j .45 

i 

1 


.28 


.31 


.34 


* 

.40 


* 

.38 


* 

.43 


1 1 

Mblned 

l=d 


** 

.48 

1 

1 


Mr 

•48 


e* 1 ** 

.48 1.48 

1 

t 


.20 


.20 

1 


*i * 

.39’ .38 

1 

t • 


i.32. 

I 

. 1 


.32 

1 1 


* 

.40 

[ 1 

. 1 
i 


* 

.40 

1 

1 

i 


* 

' .42 

i i 

1 


* : 

.42 i 

1 

1 



U " UnadJuetMl Ratings *Sisni£lcant at the .05 level 

A * Adjusted Ratings **Slgnif leant at the .01 level 



TABLE 4 

CORRBUTIONS BETWEEN SCALE RATINGS 
AMD RANKING BT EVALUATORS 

Scale 



12345 Cuffl-Pts. Overall 
UAUAUAUAUAUAUA 







** 

• 54 


Irk 

.53 


Mr 

.55 


Mr 

.55 


.15 


.13 


1 * 
.37 


.35 


.28 


.28 j 


* 

.43 


1 * 

.42 


* 

.38 


* 

.37 




J2 


* 

.45 


* 

.46 


Mr 

.48 


M 

.49 


.19, 


.21 


.30 


.34 


.32 


.33 


* 

.38 


* 

.40 


* ’ 

.43 


' k 

.45 


i 


•^3 

i 


* ' 

i.40 

1 


Mr 

.49 


.29 


.35 

J 


.24 


.28 


1 * 

.36 


* 

.42 


.26 


.31 


.34 

i 


* 

.41 


* 

.36 


* 

.42 


' ** 
!.51 

Coad>lned 
! ^ 


Mr 

1 .30 

i 


Mr 

.48, 

{ 

1 


M 

.48 


•22 j e22 

^ » t 


* 

.39 

> 1 


* 

.39 


.31 


.31 j 

1 


* ! * 

.41 .41 

1 L J 


* 1 * 

.42 .42 

1 ' ! 



U ■ Unadjusted Ratings 
A « Adjusted Ratings 



significant at the .05 leve* 
**81gnl£lcant at the .01 leve’ 



TABLE 5 

>:(nREUTIOII8 BBIVBEN SCALE RATIH6S 
AND FBACIICUH CEASE 



Scale 



12 3 4 5 

UAUAUAUAUA 


Cum-Pts. Ov< 
U A U 


eral' 

A 


1 

! 

Jl 


** 

.50 


itk 

.55 


e 

.38 


.42 


.11 


.15 


.22 


.26 


1 

.20 


.24 


.32 


k 1 

.37 


.22 


.26 


*^2 


* 

.40 


irk 

.47 


.33 


.39 


.11 


.20 


.15 


.23 


.23 


.30 


.26 


.35 


.29 


* 

.37 


•^3 


* 

.44 


* 

.43 


* 

.36 


.32 


* 

.38 


.31 


.40 


* 

.36 


.26 


.20 


* 

.39 


* 

.36 


k 

.37 

1 


.34 


i 

J1-J3 

oiri>lned 


Itk 

.49 

1 


— 

frit 

.49 

1 


' 

.39 


* 

.40 

i 


.23 

i 


.24 


.30 


.30 


.25 

t 


.26 

1 

1 


1 ♦ 
.36 

|i 

1 


CO 

• 


.32 


.32 

i 







U * Unadjusted Ratings 
A " Adjusted Ratings 



*Slgnl£lcant at the .05 level 
**81gnlf leant at the .01 level 



Predictive Validity . An effort to assess the predictive validity of the 
scales was made by correlating the first set or pre-practlcum group of films with 
the safl&e three sets of variables used to study concurrent validity. 

These findings are reported In Tables 6, 7, and 8. 
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TABLE 6 

CORRELATIONS BETWEEN SCALE RATINGS AND 
RANKING BY TOTAL STAFF oN PRE-PRACTICUM FILMS 

Scale 



1 


2 


3 


4 


5 


Cum-Pts. Overall 


|jl .39^ 


.46* 


. 53 ** 


.28 


.31 1 


.42* 


. 39 * 


|j2 .55^^ 


.49** 


.49** 


.46* 


.48** 


.54** 


.52** 


' 

J»l-J2 .48** 

•leoblned 


.49** 

1 


.55** 

: 1 


. 39 * 

1 


.42* 


.49** 


.46* 

\ 


il i 










nlflcant at 


Ctl6 # 05 



Te^vel 



♦♦Significant at the .01 level 
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TABU 7 

OOBRUATIOIB ftSTWHN SGiU RATZM68 AMD 
lAMUNG IT GW)1R8 FOR PR1-P1ACT1C»I FIU« 







TABLE 8 

CQRRELATIDMS BBTUEBM SGAIM RATINGS AM) 
FRACncm GRADE FOR PRE-PRACTICIM FIU« 

Scale 







o 
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The reliability aivi validlt:^ information deecribed above indicate that a 
criterion inatrwnent foe avaluating couneeling interviewe wae developed which is 
reliable ard valid* Meaeuree of reliability are consistently in the area of *80 
to *90* The iniitrunient was found to have concurrent and predictive validities 
which were both statistically and practically significant. Internal relationships 
between rating scales and objective behaviors related to the constructs support 

...le construct validity of the instrument. 

The instrument in short was found to be about as reliable and valid in 
predicting practicum grade or ranking from a single interview as is a typical 
scholastic aptitude tejjt in predicting grade point average in college generally. 

Construct Validity , Each scale contains a list of specific behaviors to which 
the rater must respond (by indicating whether the behavior occurred, whether It 
was appropriate, etc.) before he Indicates his scale rating on the nine-point 
continuum. Thisse beha*/ioral descriptions are considered illustrative of the 
construct measured by the scale, and are Intended to direct the rater s attention 
to relevant counselor behavior. It therefore was necessary to deoionstrate an 
empirical as well as s logical relationship between these behaviors and the scale 
ratings themselves, ibr this reason, correlations were prepared showing the 
relationship between the ratings on each scale and the number of "Yes” responses 
made by the Judges on that scale. These correlations are shown in Table 9. With 
the exception of Scal<h 3, nearly all the correlations are of substantial ftize, 

T;}ey indicate that the objective behaviors which underlie each scale did in fact 
serve as operational definitions. In a sense, these data constituted a measure 
of the construct validity of the criterion instrument. 
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TABLE 9 

CORRELATIONS BETWEEN SCALE RATINGS AND CORRESPONDING 
'*TE8" RESPONSES FOR ADJUSTED AND UNADJUSTED RATING 

Scale 



UAUAUAUA 





.81 


.73 


.82 


.75 j 


.63 


.51 


.84 


.75 


.64 


.54 


J2 


.84 


.81 


.89 


.88 


.81 


.78 


.90 


.88 


.78 


.80 


i , 

1 *^3 


.84 


.80 


.84 


! .77 

i 


.70 


.69 


,91 


.82 


.72 


.76 


1 

J1-J3 


.88 


,88 


.89 


.89 


.75 


.75 


.93 


.93 


.73 


.73 


Combined 


1 

i 1 


1 




1 

1 


1 








t 


i 




i 






1 


11 






L. i 



U <■ Unadju8t(!d Ratings 



A - Adjusted Ratings 



Study of Non-Verbal Behavior 

A second aspect major of this study Involved an attempt; 

(1) To develop a reliable, replicable method for describing the non-verbal 
behavior of counselors In terms of theoretically relevant, but teachable and 
practical dimensions; 

(2) To describe any differences and relationships between counselors rated 

high and low In terms of the dimensions; 

(3) To determine If valid and practically useful predictions of good or 
poor counseling could be made through a regression approach with an equation 
consisting of the best non-verbal categories of behavior. 

Category Development 

Seventeen non-verbal categories were developed within a two-fold general 
ramework. First, It was decided that all categories must be descriptive of 
gross body behavior which Is controlled by the voluntary muscles. Autonomic 
movements were discarded. It was decided to deal with behavior over which the 
counselor had conscious control, which could then, conceivable, be easily trained 
Thus, the categories could have practical significance. 
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Sscoody six non*’V6rb4i] cAtisgorlss tuid to bo vlslblo to tho obsorvor* Pilot 
* inspection revealed that the camera angle and desk placement precluded much 

observation of the lower half of each counselor's body. Thus, three body areas 
were chosen for study. These were: head and neck, arms and hands, and body torso. 
Jy not Including the legs and feet, it was believed that little relevant data were 
lost, since rarely was the lower half of the counselor visible to the client. 
Categories of Non-Verbal Behavior 

The following categories of non-verbal behavior were defined. 

A. Head and neck positions, movements, or shifts. 

1# Any Head Movement , including nods. 

2. Only Head Nods . 

Head is Turned Awav from client. 

SSSi is touched or supported by fingers, hand, fist, or arm 
or any part thereof. 

5* Head support is shifted to #4. 

B. Facial movements or change. 

6. Lower facial expression changed (excluding smile). 

7. Lower facial expression is a smile only. 

8. Upper facial expression changed. 

C. Arm-hand movements or shifts. 

9. Any Hand Movement , . 

10. Only a Hand-arm gesture , 

11. Any Arm Movememt . 

Body- torso movements, positions, or shifts. 

12. Body position is Forward . 

13. Body position is Upright . 

14. Body position is Backward . 

15. Body position is shifted among iM2, 13, or 14. 

E. Tongue -mouth- larynx movements 

16. Mouth -tongue -larynx movement. Counselor Talks . 

17. Shift to #16, Shift to talking. Speeches begun . 

Inspection of the above categories will reveal that Categories #5, 15, and 17 
are derived categories from others and were not directly scored from observation 
J of the films. Category #16 was scored by listening to the audio portion of the 
Interviews. Thirteen categories were scored from observing the films directly. 



o 
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Scoring 



Esch fils In the ssiaplc VaS scored ncccrulng to the following systeoi* A temn 



of trained observers (either four or five) observed each film as often as was 
necessary to complete the tally of all the categories* On each run throughy three 
observers Intently watched the behavior of the counselor for the specific category 
they were trained to observe reliably* Each observer concentrated on only one 
category during each showing* 

A buszer, connected In series to the sweep hand of an electric clock, sounded 
every five seconds* If the behavior for which the observer was watching occurred 
during the five seconds between buzzes, he would call out a pre-arranged code name 
to a recorder who sat at a table away from the projected Image, where he concentrated 
on recording the behaviors as they were called out by the observers. 

The observers sat approximately four to eight feet away from the projected 
Image which had dimensions of 2 feet by 3 feet. The recorder scored the tallies 
In the following manner* The scoring pad had 30 rows of twelve squares each* 

Each of the squares corresponded to a 5-second Interval of time. Thus, as the 
’ uzzer sounded the beginning of a new 5-second Interval, the recorder moved to the 
next square, successively, until the 360 squares had been passed over, denoting 
the end of the 30-mlnute filmed Interview. (The Interviews were slightly longer 
but only the first 30 minutes were scored*) Into the squares the recorder jotted 
the code for the behavior being called out by the observers. Each square, then, 
could have from 0 to 4 symbols In It, depending upon how many observers were 

symbols and depending on whether or not all of them observed relevant 
behavior during one Interval* It was fonnd that one recorder could easily handle, 
without error^ the response of three observers. Every successive 5 -second time 
Interval of the first 30 minutes of each film was observed and tallied In the manner 
described. 
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The tally sheets were then processed. One reader read aloud to another 
I'ecorder separately for each category code either a 0 or a 1, depending on whether 
or not the category had been tallied In the particular square. The 1 meant that 
the behavior had been called out and recorded. The recorder now entered the O's 

and the I's onto a key punch coding sheet which was subsequently used by a key 

punch operator for the preparation of data cards. Not only was each S-second 
time Interval scored with a 0 or a 1, but at the end of each block of 12 squares, 
corresponding to a minute of time, a total, ranging from 0 to 12 was entered, 

representing the total number of I'a which had been recorded for that one minute. 

It was these one-minute totals which comprised the numerical data analyzed In this 
study. 

A frequency count was not obtained for any of the categories. Instead for 
all categories, except #5, 15, 17, a measure of whether or not the behavior 
occurred In each successive 5 -second time Interval was taken. Many of the categories 
were comprised of behavior which was continuous In nature. It would give an 
unrealistic picture of the behavior If merely a frequency count were made. For 
example. If a counselor began smiling In one certain 3-second time Interval and 
continued the smile unchanged for three more consecutive Intervals, he would receive 
one tally for smile under the frequency method. Proper emphasis to duration of 
behavior was needed wlthbut timing dl ictly each behavior for Its duration. With 
the scoring system used here, the counselor In the example received a tally (a 1) 
for each time Interval In which smiling behavior occurred. It was felt that X 4 
entries for smiling behavior would more adequately reflect the magnitude of his 
smiling than one entry for frequency* In this manner, continuously occurring 
behavior Is scored In proportion to the length of occurrence. 
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Cat«fori«t #5, 13, «iid 17, were translated into data for analysis in a 
•lightly different manner. The reader will remember that for the other categories 
a one-minute total was obtained. For example, for minute one of category one for 
oounaelor one, the total night be 9, meaning that in nine of the twelve 5*seeond 
Intervals in minute one, this counselor exhibited a Head Hovemant. 

Zn like manner, minute one of catexorv four for counselor one may show the 
iioilowlng pattern: 00000111111 0, totalling 6 for minute one. It 

can be seen flat the counselor shifted to the Head Support category in time interval 
5 and stayed in that position for 30 seconds, receiving six I's. Thus for Category 
2 , for the one minute total, he would receive a 2 since he shifted twice, once into 
and once out of the Head Support, Category 4. Categories 3, 15, and 17 were 
darlved in like aumnar. For all categories, the one-giinute total was used for 
analysis. 

Siplection of the Staple Behaviors 

At the conclusion of training in June, 1964, each of the six Counselor 
e^lucation staff members separately and independently had ranked the counselors in 
t*hrms of global effectiveness as a high school counselor. From the six separate 
rankings, a pooled ranking was made, with the person rated highest ranked one, and 
the person rated lowest ranked 30. In addition, Practicum Grade for each trainee 
omMdber was later determined through a staff committee, although no reference was 
Cuxde in regard to the ranking. Thus two separate measures, based on staff judgment^ 
wttre made on each of the trainees. 

Below is a sumouiry table (Table 10) of the above judgments. 
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TABLE 10 

POOLED STAFF BANK AM) PBACTICIM GRADE FOR 
THIRTY GOOMBELmC TRAINKE8 



Original Poolad 
Staff Rank 



ractlcum 

Grade 



1 


A 


•' 2 


A 


I 3 


A 


4 


A 


! 5 


A 


6 


A 


7 


A 


i 8 


A 


; 9 


B 


i 10 


B 


11 


A 


' 12 


A 


! 13 


B 


1 


A 1 




B 


1 16 


B 


17 


B 


18 


B 


19 


A 


20 


B 


21 


B 


22 


B 


I 23 


B 




B 


! 25 


B 


; 26 


B 


1 27 


B 


28 


B 


: 29 


B 


30 


B 



tmmrnmmm 
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Two groups, « High «nd « Low group, were choeen from the 30, bated upon the 
original pooled staff rank and the practicum grade. It was decided not to 
Include the entire group of 30 in the samples. Consequently the middle ranges in 
the staff ranking were eliminated to obtain greater separation and to give greater 
opportunity for differences to appear. The non-verbal interview behavior of these 
two groups, now called the Criterion Groups, constituted the independent variables. 
The High Group consisted of counselors originally ranked 1,2,3,4,5,6,7,8,11, and 12, 
or, the highest 10 ranked persons who received A's in practictim. The Low Group 
were the ten lowest rated counselors all of whom received B's in practicum. 



Hypotheses Tested 

Three major hypotheses were tested in the analysis of the data. 

Hypothesis 1. No differences in scores on any rating scales will appear 
between the Concentrated and Distributed Practicum groups. 

Hypothesis 2. The seventeen non-verbal categories will not differentiate 
between the behavior of two groups of counselors judged to be High and Low in 
effectiveness. 

Hypothesis 3. Regression equations cannot be constructed on the basis of 
scores of the seventeen non-verbal categories which will predict whether behavior 
was drawn from "High or Low" rated criterion groups. 



Analysis of the Data 

Aq^lyfi s of Treatment Effects 

In order to analyze the effects of the Concentrated and Distributed Practicum 
Treatments, six one-way AN0¥AS were run comparing the two group scores on each of 
the five interview rating scales plus the overall interview ratings. The resulting 
F ratios are summarized in Table 11 below. 
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TABU II 

of Anolytio of Vorlanco Coaporlng Poot-Practlcus 
Znttrrlow Scorot of Diotributod and Coneontratod 
PractieuB Oroupa by Scala aad on Ovarall Eating 



a 














Beale 


1 


2 


3 


4 


5 


Ovarall 

Eating 


F ratios 

28 d.o.f. 
1 


2.33 


JI.23 


.81 


.95 


1.42 

1 1 


1.04 

1 

1 1 

1 ‘ 



Nona of tha f ratloa abova ara algnlflcant at avan tha »05 laval of 
algnlfleanca. In fact, a raauirkabla similarity batvaan tha tifo groups saams to 
axist. Aftar sixty hours of practieum traatmant in two diffarant sohadulas of 
prasantatlon, tha two groups showad qulta similar distributions of scoras, 
Hypothasis numbar ona of no diffaranca batwaan traatmants is aeeaptad. No 
diffarancas batwaan Ckincantratad and Dlstributad Practieum Traatmants wars found. 
AnalTSis of Non -Varbal Behavior 

Tha analysis was conducted in three phases: tha computing of ANOPAS, tha 
deriving of regression aquations, and cross-validation. 

iSSSA* The unit of measure for analysis was tha ona-mlnuta total for each 
category. Tha minuta-by-minuta totals ware summed over all post practieum 
films in each group. Hence, there ware 30 scores for each High group and 30 
for each Low group. A one-way ANOVA was run separately for each of tha savantaan 
non-verbal categories. Tha results of this analysis ara in Table 12 below. 
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12 

RSSULIS OF ABkmia Of VARIAliCB BBTISBN im-VKRBAL 
BBHA.VZDR GAXBOORT SCORES OF HIGH iRD LOW 1A.TED OODMS1LOR8 




7 Snll« Only 

8 Upp«r Facial 



17. + .01 

na 



Low Group 



9 Hand Hovanant 

10 Hand Gaatura 

11 Arm Movament 



12 Body Forward 

13 Body Upright 

14 Body Backward 

15 Body Shift 



16 Talk hovemant 

17 Talk Shift 



na 

20 . + .01 

33. .01 



na 

ns 

na 



44. + .01 
11. + ,01 



High Group 
Hltth Group 



Hltth Group 



High Group 
High Group 



Of the eeventeen AM0VA8 run, 10 ahowed slgnlflcenee at the *01 level. Hypotheaia 
!;aiid>er two la thua rejected In 10 of the 17 teata. It la poaalble to dlfferentlet«>. 
reliably between the non-verbal behavlora of High and Low rated counaelora. 

Thua, It can be reliably atated from the reaulta of the AHOVAS that for the 
Criterion Groupa, the counaelora In the "High Group" were character Iced bys 
(1) ahlftlng their handa to their heada, (2) geaturlng, (3) moving their anaa, 

(4) ahlftlng body pocltlona, (5) talking, and (6) beginning apeechea to a greater 
degree than counaelora In the Low Group. The counaelora In the "Low Group" were 
characterlced by: (1) moving th&ir heada, (2) nodding, (3) aupportlng their heada 
with their handa, and (4) amlllng to a greater degree than the counaelora in the 
"High Group." 
leareaalon Eouatlona 

The aeventeen predictor varlablea were combined In a multiple regreaalon 
equation for predicting the criterion of High-Low rated counaellng. Since aome 
form of croaa -validation was conaldered neceaaary to teat the uaefulneaa of theae 
equations and their theoretical relevance. It was decided to build regression 
equations using one-half of the data and croaa -validating on the remaining one-halT. 
Two auch dlvlalona were made. One-half of the total twenty intervlewa of the 
Criterion Group were aelected randomly by choosing the odd numbered minutes of 
counaellng time and building equations based on theae minute scores. Similarly 
the Hl^ and Low rated groupa of counaelora were randomly divided so that five 
counaellng Intervlewa from each group were used to build equations with the 
remaining Intervlewa saved for cross-validation purposes. 

Table 13 below shows the results from these equations based on three hundred 
minutes or one-half of the total time of the twenty half-hour interviews of the 
Criterion Group. Since It seemed possible that non-verbal behavior might vary 
from one part of an Interview to another, the Interviews were scored by ten minute 
segments or thirds as well as by total Interview to give separate equations drawn 
from first one. third, middle one. third and final one. third of the data. 
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TABLE 13 

CR ITERI ON GROUPS: 300 ONE^HINUTE SAMPLING OF NON-VERBAL 

INTERVIEW BEHAVIOR REPRESENTING TEN RANDOMLY SAMPLED 
COMPLETE INTERVIEWS BY TOTAL AM) BY TIME SEGWIT 



Interview Portion 


Predictors 


& 


r£ 


Total » 


2,3,6,11,X4,15 


.517 


.267 


First 1/3 


2,3,6,9,12,13 


.533 


.284 


; Second 1/3 

t 


2,4,6,11 


• 514 


.264 


Third 1/3 


2,3,14,15 


.671 


.451 


l«Head Movement 
2"Head Nod 
3’4ead Away 
4H3ead Support 
5-fiead Support Shift 
6»IiOwer Facial Movement 
7«Smlle Only 
8«Upper Facial Movement 
9 -Hand Movement 


10-Hand Gesture 
ll<^Arm Movement 
12»Body Forward 
13»Body Upright 
14*Body Backward 
15-Body Shift 
16>C!alk 
17-Talk Shift 






As Table 13 indicates. 


when the one minute non-verbal 


behavior 


scores on t 



significant categories are taken on one-half of the high rated and one-half of the 
low rated counselor complete interviews* we are able to predict the criterion of 
High -Low rated counselor with multiple R*s on the order of ,5 to ,6. 

Table 14 below shows multiple R*s obtained by taking random samples 
composed of odd-nuinbered minutes of all Criterion Group interviews* These multiple 
R's are slightly lower, but continue to predict the criterion at a substantial 





level. 
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TABLE 14 

SmiARY TABLE (3T KULTIPLE OORREUTIDN COEFFICIENTS RESULTING FROM 
C0MBU!(ATI0NS of THE BEST OF SEVENTEEN INDEPENDENT 
PREDICTORS WITH THE CRITERION 



CRITERION GROUPS: 100 ONE MINUrE SAMPLES OF NCN-VERBAL COUNSELOR BEHAVIOR 
TAEEN EQUALLY FROM BACH INTERVIEW BT TOTAL AND BT TIME SEGMENT 


Interview Portion 


Predictors 


R 


si 


Total 


2,3,7,11,16 


.474 


.224 ' 


First 1/3 


1,3,5,16 


.485 


.235 


Second 1/3 


2,16 


.470 


.221 


Third 1/3 


2,3,11 


.474 


.224 



IHSlead Movemeat 
2*Head Hod 
3Hiead Away 
4HHead Support 
5«Haad Support Shift 
6*Lowar Facial MovenMrit 
7«Smlla Only 
Scupper Facial Movaanant 
9*^nd Movamant 



lO^and Gastura 
ll>^rm Movamant 
12»Body Forward 
13«Body Upright 
14«Body Backward 
15«Body Shift 
16>4?alk 
17"Talk Shift 



Croa a -Validation 

An affort to croas-valldate the equatlona obtained In the procedurea 
daacrlbed above was coade to determine the amount of ahrlnkage found when the 
equatlona ware uaed with Independent samples of behavior. It was decided to express 
the results of the procedure In terms of the percentage of correct assignments Into 
High or Low rated groups for repeated one-minute samples of behavior taken from the 
remaining one-half of data. In other words, a statistic was used expressing 
the percentage of correct assignments of one-minute samples of one-half of the 
data which could be made with the use of regression equatlona built on the alternate 
half. 

Two divisions of the data had been made as described above. Table 15 below 
shows the results from the cross-validation made within Interviews and Including 
all counselors In the Criterion Group. 
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SIMKARY TABU OF CRITERION GROUP CROSS VALIDATION 
(WITHIN COUieSlORS) 20 FIVE MINUTE COUNSELING SEGMENTS 
SAMPLED RANDOMLY AMD EQUALLY FROM EACH OF 20 INTERVIEWS 



Int«rvl«w Portion 
Firit 1/3 



Prodlctors 

1,3,5,16 



Results 
Predicted 
High Low 
High 7 3 

Known 

Low 2 8 



10 

10 

20 



15/20-75X predicted correct? 



CRITERION GROUP CROSS VALIDATION: 

100 ONE-MINUTB COUNSELING SEGMENTS 
SAMPLED EQUALLY FRiCRl EACH OF 20 INTERVIEWS 



Interview Portion 
ieoond 1/3 



Predictors Results 

Predicted 





High 


Low 




High 

Known 


32 


18 


50 


Low 


19 


31 


50 

100 



63/100^3% predicted correct 



CRITERIDN GROUP CROSS VALIDATION: 

20 FIVE-MINUTE COUNSELING SEGMENTS 



RANDOMLY AMD 


EQUALLY FROM EACH OF 20 INTERVIEWS 






Interview Portion 


Predictors 


Results 










Predicted 






Second 1/3 


2,16 


High 


Low 








High 9 


1 


10 






Known 










Low 1 


9 


10 










20 



18/20*^0% predicted correctly 



o 
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(TABLE 15 Continued) 



CRITERION GROUP CROSS ?jp:*IDAT10N: 

100 ONE-MINUTE COOiSELllC SE GMENT S 
SAMPLED EQUALLY FROM EACH OP 20 INTERVIEWS 



Low 

17 50 

36 50 

100 

69/100-69% predicted correctly 



t 



CRITERION GROUP CROSS VALIDATION; 

20 FIVE-MINUTE COUNSELING SEGMENTS 
RANDOMLY AND EQUALLY FROM EACH OF 20 INTERVIEWS 

Interview Portion Predictors Results 

Predicted 

Third 1/3 2,3,11 ^^8^ 

High 9 

Known 

Low 1 



18/20-90% predicted correctl>| 

i 

■ -■ 

- ' ..I .11. I . . I T 



Low 

1 10 

9 10 

20 



Interview Portion 
Third 1/3 



Predictors 

2,3,11 



Results 
Predicted 
High 
High 33 

Known 

Low 14 



As Table 15 shows, when a regression equation based on the odd numbered 
minutes of interview time is tested against the even numbered minute scores, the 
equation holds up to the extent that when twenty clusters of five one-minute 
samples of behavior are assigned using the equation, correct assignments are made 
in from 75% to 90% of the cases. Chance on this dichotomous criterion is of course 
50%. This is more accurately a measure of the internal reliability of the non- 
verbal behavior scores than a cross-validation since the comparison is within 
interviews and not across counselors. 



o 
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When the across counselor comparison is made, that is when one-half of each 
of the High and Low groups are compared with the other half, more shrinkage of 
predictive efficiency occurs. Table 16 below shows these results. 



TABLE 16 



SUMKARY TABLE OF CROSS-VALIDATION ACROSS COUNSELORS 
USING REGRESSION EQUATIONS DERIVED FROM ONE-HALF 
OF THE COUNSEIORS TO PREDICT CRITERKMJ VIA DISCRIMINANT 
METHOD WITH OTHER BAIF OF COUNSELORS 



CROSS-VA1.IDAT10N 

300 ONE -MINUTE COtrNSELING SEGMENTS 
SAMPLED EQUALLY FROM EACH OF 20 INTERVIEWS 



Interview Portion 
Total 



Predictors 



2,3,7,11,16 



Results 

Predicted 





High 


Low 




High 

Known 


66 


84 


150 


Low 


44 


106 


150 

300 



172/300*57% predicted correctly 



CROSS-VALIDATION: 

60 FIVE-MINUTE COUNSELING SEGMENTS 
SAMPLED RANDOMLY AND EQUALLY FROM EACH OF 20 INTERVIEWS 



Interview Portion 


Predictors 


Results 






Total 




Predicted 






2,3,7,11,16 


High 


Low 








High 19 


11 


30 






Known 










Low 3 


27 


30 



60 

46/60*77% predicted correctly 
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(T A B L E 16 Continued) 



CROSS-VALIDATION: 

100 (HIB-MINUTE COUNSELING SEGMENTS 



SAMPLED EQUALLY FROM EACH OF 


20 INTERVIEWS 






Interview Portion 


Prwllctors 


Results 






First 1/3 




Predicted 






1,3,5,16 


High 


Low 








High 29 


21 


50 






Known 










Low 20 


30 


50 










100 



59/100*59% predicted correctly 



As Table 15 shows when cross-validation across counselors is done, the 
percentage of correct predictions shrinks considerably. Here the equation will 
predict correctly from 55% to 77% of the time. While these results are considerably 
better than chance, they indicate that predictive efficiency of an equation 
based upon one group of counselors does shrink when tested upon another group of 
.similarly rated counselors. 

These results do demonstrate the fact, however, that it is possible to construct 
regression equations which can differentiate between the behavior of High and 

Low rated counselors at better than chance levels. Thus, null hypothesis number 
three is rejected. 



Conclusions and Inq>lication8 

This study was deliberately planned as a preliminary and, in a sense, a pilot 
study devoted as much to the development of a methodology for studying outcomes 
in counselor education as for the production of highly definitive evidence regarding 
the evaluation of counselor education practices. 
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A nu^r of vory ro«l llaltatiofu autt bo kopt In aind In any Intorprototlon 
oj tho Totulto of tho study* Firsts oil of tho thirty couniolori"ln"trolnlng 
oho aoTO studiod in this project were in one counselor education prograa* 

Criteria used were prlsarily Judgaents by aeabers of one counselor education staff, 
or inetruaents developed to measure objectives of that counselor education prograa* 
Oeoeralisability of results beyond this program is very dangerous* Agreement 
y 4 ng gools of both Counseling and counselor education is presently so limited 
little coaaonality in point of view can be assumed between any two programs * 
Secondly, the filmed samples of counselor behavior used as a basis for 
ohservationa were limited to initial interviews of only one-half hour* Both 
eouneelors and clients were aware of the filming process and undoubtedly some 
artificiality of behavior was introducted into their interaction* 

Finally, the criteria used are entirely confined to assessments of interview 
process and have not been shown to be related to any kind of ultimate criterion of 
eounaelor effectiveness, that is a criterion based on actual changes in client 
behavior. Research which is devoted to identifying relationships between 
intermediate, process kinds of criteria and output variables In terms of client 
change, is needed before the interpretation of changes in counselor interview 
behavior can be very meaningful* 

Bespite these limitations this study did produce a number of the findings which 
are both practically and theoretically important. 

First, as a result of this project a set of measuring instruments was 
developed which were tied to objectives of the counselor education program and which 
iMre firmly rooted in the interview behaviors of counselors -in- training. This 
instrument was found to be reliable in the hands of experienced counselor educators 
ard to be valid in predicting practicum grades and staff ratings of trainees* 

o 



mmmm 



- 32 - 

In fact, this initruatnt vat mbit to pradlct practleua gradat givan tlx nontht 
latar about at vail at tcholattle aptltuda taitt givan In high tehool ara abla 
to pradiet colXaga gradat* 

Using tcorat on thit inttruxant at a critarion, tha outconaa of two typat of 
countaling practieun traatnantt vara attattad* A Dittributad Practicun Group 
rhich had sixty hours of tuparvitad praeticun dittributad ovar a six aonth pariod 
vat found to ba no diffarant in tamt of naaturad outconst than a Concantratad 
Practieun Group vhich had racaivad tha traditional praeticun contitting of tha tnat 
mndbar of hours concantratad into tha final thraa nontht of tha progran* 

Saeondly, it vat found pottibla to diffarantiata batvaan tha non-varbal 
Intarviav bahaviort of High and Lev ratad countalort-in-training on tan catagoriaa 
of bahavior* Thata ratultt indicatad that High ratad counsalort tandad to ba nora 
activa aninatad in tamt of grots body novanantt than Lov ratad counsalort* 

Low ratad counsalort tandad to uta haad and facial novanantt of nodding and 
tnlling to a graatar dagraa* Thay vara physically nora llmitad in novanantt, 
suggasting a kind of pattiva and rigid pattam of bahavior. 

Hhan fraquancy tcorat on datagoriat of non-varbal bahavior vara utad at 
prndictor v^iriablat, it vat pottibla to construct ragrattion aquations which could 
p^adict whathar givan tanplat of intarview bahavior wara drawn fron filnt of High 
og: Low ratad counsalort* Upon cross-validation on indapandant tats of ttaiplat, 
fiata aquations continuad to pradiet abova chanca lavalt* 

Tjppli^atlont for Futura gatfaygh 

A nusd»ar of dir actions for futura rataarch ara opanad by thit study. Tha 
ability of tha tan non-varbal bahavior catagoriaa to diffarantiata batwaan High and 
Low ratad counsalort should ba ratastad on a naw group of counaalort. Tha 
ralationthip of both varbal and non-varbal countaling process variables to client 
satisfaction and client behavior change should ba Invastigatad* Parsonallty 
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‘varlablat anong counialori with dlffarlng pattams of non-varbal iNihavlor ahould 
ba attidlad in ordar to Idantlfy potalbla ralatlonshlpa. 

Praetieum traataanta baaad upon varying traataanta including group dynaadea, 
bahavior modification, and rola modaling ahould ba comparad uaing inatrumanta 
davalopad in thia atudy. 
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PiTBRVIBW RATINS BCkUS 
H«rb«rt N« lurks, 

Attached is * s«t of scalst for avaluatlng fiva dlnatisloiis of counsalor bahavior 
In tha Intarvlawt 

Scala No. 1 - Rola Adaptation 
Scala N6. 2 - Cognitiva Flexibility 

Scala No. 3 > Consistency of Coamunication batvaan Verbal and 

Nonverbal Babavior 

Scala No. 4 <• Perceptual Sensitivity 
Scala No. 5 - Involvaoant with Client 

For each scala, tha rater is asked first to make a Judgment concerning each of 
tha specific behaviors listed, according to tha directions for that scala. Ha 
is than asked to assign a number from 1 to 9 to indicate his rating for tha 
counsalor on that particular dimension. 

After completing the five scales, the rater li asked to assign a number from 1 
to 9 to indicate his general evaluation of tha interview. 

Each scala should be evaluated on its own merits, without regard to any of tha 
other scales. Likewise, the evaluation of the interview as a whole should be 
made on the basis of one's general impression, without conscious reference to 
the five scales. 
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Counts lor 
D«t« 



Sctlt No, 1| Rolt Adaptation 

In ordsr to meat tha cliant*a naedt, tha countalor la of tan callad upon to play 
a wlda variaty of roles in tha Intarviav. Hia auceeaa in using various rolaa 
depends upon several factors! (a) the nuaber of roles in which he is able to 
engage; (b) his ability to choose tha proper role at a particular point in time 
with a particular client; (c) his ability to shift roles in an efficient manner 
as tha need arises (or, conversely, to continue in his present role If there is 
no need to shift). 

Observation of Specific Behaviors : The following behaviors are grouped according 

to various counselor roles. For each behavior, you are asked to make two Judgments! 
(1) whether or not the counselor engaged in this behavior, and (2) whether his 
engaging or not engaging in the behavior was appropriate. For ea^h behavior, 
circle "A" (for "Appropriate”) or ”1*' (for "Inappropriate”) under the applicable 
heading. 

Did Not 



Advising 

1, Encourages the client to accept responsibility 
for his own actions and decisions, 

2, Tells the client that only he (the client) can 
make a decision, 

3, Tells the client he can change his behavior if 
he tries, 

4, Suggests one solution to the client's problem, 

5, Advises the client to take a particular course of 
action. 



Engaged In Engage In 

A I A I 

A I A I 

A I A I 

A I A I 

A I A I 



Exploring Alternatives 



6 . 



Serves as an objective "reality-tester"; for 
example, helps the client to think about important 
aspects of a problem or of a situation which he 
has not considered. 



7, Encourages the client to think of alternative 
solutions to his problem. 



6. Mentions all possible consequences of the client's 
behavior. 



9 , Points out choices open to the client ( 



Facilitating Client Communication 

10, Liatens for a cotwlderable period of tine witheeb 
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commenting. 






A 

A 



I 

I 



A I 

A I 

A I 

A I 



A I 



fliiennas for the Client to 



depends upon toveral factors t (a) tha nuabar of rolas In which he Is able to 
engage; <b) his ability to choose the proper role at a particular point in time 
with a particular client; (e) his ability to shift roles in an efficient manner 
as need arises (or, conversely, to continue in his present role if there is 
no need to shift). 



Observation of Specific Behaviors i The following behaviors are grouped according 
to various counselor roles. For each behavior, you are asked to make two judgments; 
(1) whether or not the counselor engaged in this behavior, and (2) whether his 
or not engaging In the behavior was appropriate. For each behavior, 
circle "A” (for "Appropriate") or "!*' (for "Inappropriate") under the applicable 
heading. 



Did Not 

Hngaged In Bngage In 



Advising 



1. Encourages the client to accept responsibility 

for his own actions and decisions. A I 

2. Tells the client that only he (the client) can 

make a decision. A I 

3. Tells the client he can change his behavior if 

he tries. A I 

4. Suggests one solution to the client's problem. A I 

5. Advises the client to take a particular course of 

action. A I 

Exploring Alternatives 

6. Serves as an objective "reality-tester"; for 
example, helps the client to think about Important 



aspects of a problem or of a situation which he 

has not considered. A I 

7. Encourages the client to think of alternative 

solutions to his problem. A I 

6. Mentions all possible consequences of the client's 

behavior. A I 

S) • Points out choices open to the client. A I 



Ft4cllitating Client Communication 

10. Listens for a considerable period of tine wlthant 



commenting. A I 

11. Usually waits during silences for the client to 

respond . A I 

12. Frequently restates what the client has said. A I 

13. Frequently clarifies what the client is saying. A I 

14. Frequently reflects feelings of the client. A I 



A I 

A I 

A I 

A I 

A I 

A 1 

A 1 

A I 

A I 



A I 

A 1 
A' I 
A 1 
A I 



Scale No. 1 



2 . 




□ 



Information-fliviny i 



Did Not 

In IMW m 



15. Suggeata aourcea of infonoation the client may 
uae to anawer hla queationa. 


A 


I 


A 


I 


16. Offera the client educational, occupational, 
and/or other klnda of factual Information. 


A 


1 


A 


t 


17. Provldea the client with factual Information 
when he requeata It. 


A 


I 


A 


I 


S truetur Infl; 

18. Aaka the client how he feela about the Interview 
being recorded or obaerved. 


A 


I 


A 


I 


19. Aaka the client why he la aecklng counaellng. 


A 


1 


A 


I 


20. Aakii the client what he ezpecta from counaellng. 


A 


I 


A 


I 


21. Expllalna hla purpoaea In the Interview to the 
clliint. 


A 


I 


A 


I 


22. Dlacuaaea hla role with the client. 


A 


I 


A 


I 


23. Makea a truetur log remarka when the client aeema 
unaure aa to the purpoaea of the Interview. 


A 


I 


A 


I 


Support In]^ 

24. Makea encouraging, reaaaurlng remarka to the client. 


A 


I 


A 


I 


25. Pralaea or compllmenta aomethlng the client haa 
aald or done. 


A 


1 


A 


I 


Teachlna 

26. Xnterpreta teat reaulta to the client. 


A 


I 


A 


I 


27. Teachea a method of problem- aolving; helpa the client 
to explore waya of aolving problems In general, or 
waya of aolving a particular problem. 


A 


I 


A 


I 


28. Bngagea In an explicit role-playing aituation 
with the client. 


A 


I 


A 


I 


29. Explains or interprets orally the client's behavior. 


A 


I 


A 


I 


30. Mentions what other people might do in the client's 
situation. 


A 


1 


A 


I 


31. Makes a verbal evaluation of the client's plana 
or Ideas. 


A 


1 


A 


I 


Miscellaneous 

32. Engages in a friendly discussion of a general topic. 


A 


I 


A 


I 


33. Lets the client select the topics of the Interview. 


A 


I 


A 


I 



ER|C ^« Dl*cu»s«» the client's educational and vocational 

- ~ 



17. Provides the client with fsctuel Informtlon 

when he requests it* AX 

Structuring 

18* Asks the client how he feels shout the interview 

being recorded or observed « A I 

19* Asks the client why he is seeking counseling* A I 

20« Asks the client whet he expects from counseling* A I 

21* Explains his purposes in the interview to the 

client* A I 

22* Discusses his role with the client* A I 

23* Makes structuring remarks when the client seems 

unsure as to the purposes of the interview. A I 

Supporting 

24* Makes encouraging , reassuring remarks to the client* A I 

25* Praises or compliments something the client has 

said or done* A I 

Teaching 

26* Interprets test results to the client* A I 

27* Teaches a method of problem~solving; helps the client 
to explore ways of solving problems in general, or 
ways of solving a particular problem* 

28* Engages in an explicit role-playing situation 
with the client* 



A I 

A I 



A X 

A X 

A X 

A X 

A X 

A I 

A X 

A X 

A X 

A X 

A I 

A X 



29* Explains or interprets orally the client's behavior* A X 

30* Mentions what other people might do in the client's 

situation* A X 

31* Makes a verbal evaluation of the client's plans 

or ideas* A I 

Miscellaneous 

32* Engages in a friendly discussion of a general topic* A X 

33* Lets the client select the topics of the interview. A X 

34* Discusses the client's educational and vocational 

plans* A X 

35* Asks questions intended to get factual information 

about the client* A X 



A X 
/. I 

A X 

A X 

A X 

A X 

A X 
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Scale No, 1 

- 3 » 

Qvcr*l l Rating on Role Adaptation s Considering the definition of this dimension, 

^ the specific role behaviors observed, and the degree to which these behaviors were 
used appropriately, circle a number on the following scale to indicate your 
overall rating of the counselor on Role Adaptation , 



1 



2 



3 




9 



Apparently has 


Apparently has 


Apparently 


Apparently 


Apparently has 


available a 


available a 


has available 


has available 


available a 


limited number 


limited number 


several roles 


a broad range 


broad range of 


of roles, but 


of roles, but 


and is able 


of roles. 


roles. Engages 


uses them 


has difficulty 


to employ 


Engages in 


in appropriate 


inappropriately 


applying them 


them approp- 


appropriate 


roles at all 


throughout the 


appropriately. 


riately, but 


roles at 


times. Shifts 


interview. 


Frequently 


often shows 


nearly all 


quickly and 


Persists in an 


persists in 


hesitation 


times, but 


smoothly from 


inappropriate 


an inappropriate 


in shifting 


shows some 


one role to 


role and/or 


role. Often 


from one 


hesitation 


another as 


changes roles 


seems “lost,” 


role to 


and 


the need 


in a seemingly 


and resorts 


another. 


uncertainty 


arises but does 


capricious 


to ineffective 


However , 


in shifting 


not shift 


manner. 


fwnbling and 


recovers 


from one 


prematurely or 


Seems unaware 
that he is 
“lost,” 


searching. 


and "finds 

himself” 

relatively 


role to 
another. 


unnecessarily. 



soon. 




Ratar 



Gounaalor^ 

Data 



Scale No. 2: Cognitive Flexibility 

The counaelor la a peraon to whom a client cornea to get a freah and different 
perapective about himself and hla concerna. In meeting tbla need, the counaelor 
reaponda In diverse and creative ways which reflect his "Cognitive Flexibility.” 
There are three aspects to this dimensioni (a) the counselor’s range of 
psychological concepts for understanding human behavior; (b) hla repertoire of 
Interview techniques within a particular role; and (c) hla supply of relevant 
Information about the client and hla world. 

of Specific Behaviors ; The following are some of the behaviors from 
which Cognitive Flexibility may be inferred. For convenience In performing the 
^erall rating at the end of this scale, the specific behaviors to be observed have 
behavior^^*** according to the three components of Cognitive Flexibility. For each 

Circle "YES" if the behavior occurred In this Interview. 

Circle llJ®" if the behavior should have occurred in this interview, but did not* 
rc e *N/A (for **Not Appllcablfi"} if the behevlor felled oo occur beceuse 
it was Irrelevant to this interview. 

Psychological Concepts 

1. Responds in ways which suggest that he has a 
consistent psychological framework for understanding 
the client's behavior. 

2. Uses test scores and other information to construct a 
psychological "picture" of the client. 

3. Combines seemingly unrelated facets of the client’s 

problem or situation in ways that make"psycho logical 
sense." 

4. Suggests tentative causal relationships between 
past experiences and the client’s present behavior. 

5. Uses clinical hunches. For example, explores the 
possibility that a client’s hostility toward 
authority figures is related to his feelings 
about his parents. 

Interview Techniques 



YES 


MO 


N/A 


YES 


MO 


N/A 


YES 


NO 


N/A 


YES 


MO 


N/A 


YES 


MO 


N/A 
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9 , 



Responds with an economy of words; does not ramble 
or repeat himself unnecessarily; is not overly wordy. 


YES 


NO 


N/A 


Uses a wide variety of "leads" to help the client talk 
about his situation. 


YES 


MO 


N/A 


Helps the client to focus on a particular topic. 


YES 


NO 


N/A 


Asks questions which seem to have a clear and 
relevant purpose in the interview; does not ask 
a "standard catalog" of questions. 


YES 


NO 


N/A 



L. O . 

[ manner, i.e.. 



fMroDdt In dlvnrtt and eraatlva vayt iihleh raflaet his **CotnitlT« FliKibllity*'* 
flMra art cbraa aapacta to this dlaanaiont (a) tha eouaaalor'a raaga of 
foyehologieal eoneapta for uadarotaodlag humuk bahaaior{ (b) bla rapartoira of 
iatarvlav tachnlquaa vithin a particular rolai and (e) bit aupply of ralavaat 
iaforiMtlon about tba cllant and bio nor Id* 



Obaarvation of Soacific Babaviora t Tba follouing ara aoaa of tba babariora froa 
iibieb Cognitiva Plaxibility aay ^a infarrad* For cotnranianca in par faming tba 
ovarall rating at tba and of tbia ocala, tba opacific babaviora to ba obaarvad bara 
baan grouped according to tba tbraa componanta of Cognitive Flexibility* For aacb 
behavior: 

Circle "TI8" if tha behavior occurred in tbia intarviav* 

Circle "NO" if the behavior ohould have occurred in tbia intarviavi but did not 

Circle **N/A" (for "Not Applicable") if tha behavior failed go occur bacauaa 
it vaa irrelevant to tbia intarviev* 



FtTcholotical Concapta 

1« Eaapondo in wayo which auggeat that ba haa a 

conaiatent paychological fraawwork for undaratanding 





tha client 'a behavior* 


TXS 


NO 


N/A 


2* 


Uaaa teat acorea and other information to conatruct a 
paychological "picture" of the client* 


TBS 


NO 


N/A 


%. 


Coid>ineo seevlngly unrelated facets of tba client's 
problem or situation in ways that make"paychologieal 

sense*" 


TBS 


NO 


N/A 


4 . 


Suggests tentative causal relationships between 
past experiences and the client's present behavior* 


TBS 


NO 


N/A 


3. 


Uses clinical hunches* For example, explores the 
possibility that a client's hostility toward 
authority figures is related to his feelings 
about his parents* 


TBS 


NO 


N/A 


Interview Techniauea 

6« Raaponde with an ecopooiy of worda; does not ranble 
or repeat himself unnecessarily; is not overly wordy* 


TBS 


NO 


N/A 


7 . 


Uses a vide variety of "leads" to help the client talk 
about his situation* 


TBS 


NO 


N/A 


8. 


Helps the client to focus on a particular topic* 


TBS 


NO 


N/A 


9 . 


Asks questions which seem to have a clear and 
relevant purpose in the interview; does not ask 
a "standard catalog" of questions* 


TBS 


NO 


N/A 


10* 


Phrases questions in an open-ended manner, i*e«, 
which cannot be answered simply "Yes" or "No*" 


TBS 


NO 


N/A 


11* 


Asks the client to tell him oiore about a topic* 


TBS 


NO 


N/A 


12* 


Achieves movement in the interview* There is an evident 
and sensible progression of topics* 


TBS 


NO 


N/A 


13* 


Speaks of test results in descriptive terms rather 
than scores* 


TBS 


NO 


N/A 


U. 


Piacuaama the relationship of teat results to other 
Information about the client* 


TBS 


NO 


N/A 
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13. 


Uses disgrens, sketches, or other visual aids in 
the interview* 


TB 


MO 


M/A 


16. 


Asks the client to stats how he would like to 
change his behavior. 


TBS 


MO 


M/A 


17. 


Tentatively suggests an approach or solution to ^s 
problem under discussion which the client has not 
mentioned. 


TBS 


MO 


M/A 


18. 


Tentatively suggests some new behavior which the 
client might try out to Improve his situation. 


XIB 


NO 


N/A 


19* 


Asks the client to stmnarise what has been said. 


TBS 


MO 


M/A 


20. 


Summarises what has been said. 


TBS 


MO 


M/A 


21, 


Offers the client an opportunity to return for 
another interview. 


TBS 


MO 


M/A 


Supply of Relevant Information 








Responds in ways which suggest that hei 








22. 


has an adequate supply of information about the 
client (e*g«, cumulative record information). 


TBS 


MO 


M/A 


23* 


has an adequate supply of educational information 
(colleges, trade and technical schools, etc*)* 


TBS 


MO 


M/A 


• 

CM 


has an adequate supply of occupational information 
(general knowledge of the world of work, inf onsation 
about the occupational areas in which the client has 
expressed an interest, etc*)* 


TBS 


MO 


H/A 


25. 


has an adequate knowledge of sources of information 
(directsries, catalogs, people, etc*, that the 
client might consult for answers to his questions). 


TBS 


MO 


N/A 



Ovrall Rating on Cognitive Pl«xlbtlity : Considering the definition of this dimension 

and the specific behaviors observed in the interview, circle a number on the 
following scale to Indicate your overall rating of the counselor on Cognitive 
yi«aibility > Bear in mind that the three components of this dimension arej 
^a) psychological concepts, (b) interview techniques, and (c) relevant 
information* 






1 



2 





9 

I 



1 



tiOW on all 
.hree 

components * 

Uses a very 
limited range 
of psychological 
concepts, 

Q Interview 
ERJC techniques 



Low on two 
components ; 
or low on 
one and 
moderate 
on two* 



Moderate on 
all three 
components ; 
or high on 
one, moderate 
on one, and 
low on one* 






High on two 
components; 
or high on 
one and 
moderate 
on two* 



High on all 
three 

components* 
Uses a wide 
range of 
psychological 
concepts, 
interview 
techniques, an 
relevant 

.. 




- 2 - 



8eal« No. 2 



“) 





the Interview. 


TB 


m 


M/A 


16* 


Asks the client to state how he would like to 
change his behavior. 


TB8 


m 


l/A 


17. 


Tentatively suggests an approach or solution to ths 
problem under discussion which the client has not 
mentioned. 


TBS 


m 


H/A 


18. 


Tentatively suggests some new behavior which the 
client might try out to Improve his situation. 


TB8 


NO 


N/A 


19. 


Asks the client to summarise what has been said. 


TBS 


NO 


H/A 


20. 


8ummarlses what has been said* 


TBS 


NO 


H/A 


21. 


Offers the client an opportunity to return for 
another Interview. 


TBS 


NO 


H/A 


Supply of Relevant Information 








Responds In ways which suggest that has 








22. 


has an adequate supply of Information about the 
client (e.g., cumulative record informatlony* 


TBS 


NO 


H/A 


23. 


has an adequate supply of educational Information 
(colleges, trade and technical schools, etc*)* 


TBS 


NO 


N/A 


24* 


has an adequate supply of occupational Information 
(general knowledge of the world of work, Information 
about the occupational areas In which the client has 
expressed an Interest, etc*)* 


TBS 


NO 


H/A 


25. 


has an adequate knowledge of sources of Information 
(directories, catalogs, people, etc*, that the 
client might consult for answers to his questions)* 


TBS 


NO 


R/A 



Rating on Cognltlv Fl<xlbility : Considering the definition of this dimension 

and the specific behaviors observed In the Interview, circle a number on the 
following scale to Indicate your overall rating of the counselor on Cognitive 
]p.yKlblllty > Bear In mind that the three components of this dimension ares 
(a) psychological concepts, (b) Interview techniques, and (c) relevant 
Information* 



9 



^ tiow on all 
.hree 

components* 

Uses a very 
limited range 
of psychological 
concepts, 
interview 
techniques 
pn^^^ind relevant 

miiM^Br«an Lnformatlon« 



Low on two 
components ; 
or low on 
one and 
moderate 
on two* 



j 1 



Moderate on 
all three 
components ; 
or high on 
one, moderate 
on one, and 
low on one* 



High on two 
components; 
or high on 
one and 
moderate 
on two* 



High on all 
three 

components* 
Uses a wide 
range of 
psychological 
concepts , 
Interview 
techniques, an 
relevant 
Information* 



Rat«r 




Counatlor 

Data 



Scala No. 3: Conalatencv of Coamunication batwaen Verbal and Non-Varbal Behavior 

Tha cotmaalor connunicatea with tha cllant in verbal and non-verbal vaya. Be 
aenda out "aignala" to the client by meana of (1) what he aaya verbally, and 
(2) hia voice inflection, facial expraaaion, poature, geaturea, and manner iaina. 

The counaelor'a Cona latency of Coonunication can be aacertained by obaervlng 
the degree to which hia verbal and non-verbal behavlora are compatible, i.e., 
the extent to which they convey the aaaie meaning. 

Qbaarvation of Specific Behavior a ; The following are aome of the apecific 
behaviora from which Cona latency of Communication may be inferred. For each 
behavior 1 

Circle "YES" if the behavior occurred in thia interview. 

Circle ’*N0" if the behavior ahould have occurred in thia interview but did not* 
Circle "N/A" (for "Not Applicable") if the behavior failed to occur becauae 
it waa irrelevant to thia interview. 

1. Admita hia ianorance when hie non-verhel hehevlnr 





"pusiled" facial expraaaion) auggeata that 
he ia unable to anawer the client 'a queation. 


YES 


NO 


N/A 


2. 


When hia facial expreaaion or other non-verbal 
featurea auggeat that he does not agree with the 
client, he atatea hia diaagreement verbally. 


YES 


NO 


N/A 


3. 


When his non-verbal behavior (e.g., looking away 
from the client, "startled' facial expression) 
suggests that he is shocked or offended by something 
the client has said, he states his feeling to 
the client. 


YES 


NO 


N/A 


4. 


Smiles when he makes a humorous remark to the client. 


YES 


NO 


N/A 


5. 


Frowns when he states that he does not conq>rehend 
what the client is saying. 


YES 


NO 


N/A 


6. 

f 


Frowns when he states his disapproval of something 
the client has said. 


YES 


NO 


N/A 


7. 


When he looks perplexed by something the client 
has said, he mentions his confusion to the client. 

In such situations, he does not nod or say "Iftn-hum," 
"I see," "I understand," etc. 


YES 


NO 


N/A 


8. 

f \ 


Hods when his remarks suggest that he agrees with 
something the client has said* 


YES 


NO 


N/A 


9. 


Shakes his head from side to side when he states 
his disagreement with something the client has said* 


YES 


NO 


N/A 


10. 

u 

ERIC 


Tone of voice is compatible with the verbal content 
of his responses. For example, when he says, "I 
understand how you feel about this problem, "his 
voice tone commmicates an earnest "I really know how 
you feel," rather than a business-like know how 









vvawst i incn ^(i client in vtf^al and non -verbal vtyt* It 

"itgMli" to tho cllont by >mm of (1) «h«t ho toy* vorbolly, ood 
hl» volco tnfloctlon, foetal axpraatlont poaturot •aoturooi and ■aanartoBo* 

The counaelor • Oonaiatency of Coomunlcetlon can be eecertalned hj obeerving 
the degree to which hie verbal end non-verbal behevlore ere coopetlble, iae». 

®*tent to which they convey the leiM BMining* 

QkiJgyetion of Specific Beheviorai The following ere eome of the epecific 

which Coneietency of Coonunicetion may be inferred. For each 
oeneviors ~ ' 

Circle ii the behavior occurred in thic interview. 

should have occurred in this interview but did not. 
Circle N/A (for Not Applicable") if the behavior failed to occur because 
it waa irrelevant to thia interview. 






3 . 



7 . 



8 . 



10 , 



12 . 



13 . 



o 

ERIC 



Adnita hia ignorance when hia non-verbal behavior 
"puasled" facial expreaaion) auggeata that 
he ia unable to anawer the client 'a queation. 


TBS 


m 


N/A 


When hia facial expreaaion or other non-verbal 
featurea suggeat that he doea not agree with the 
client, he atatea hia diaagreement verbally. 


TBS 


NO 


N/A 


When hia non-verbal behavior (e.g., looking away 
from the client, "atartled* facial expreaaion) 
auggeata that he la akocked or offended by aomethlng 
the client has aaid, he atatea hia feeling to 
the client. 


TBS 


NO 


N/A 


Smllea when he makea a humoroua remark to the client. 


TBS 


NO 


N/A 


Frowna when he atatea that he doea not comprehend 
what the client is saying. 


YES 


NO 


N/A 


Frowns when he states his disapproval of something 
the client has said. 


TBS 


NO 


N/A 


When he looks perplexed by something the client 
has said, he mentions his confusion to the client. 

In such situations, he does not nod or say "Um-hum." 
"I see," "I understand," et~ 


YES 


NO 


N/A 


Nods when hia remarks suggest that he agrees with 
something the client has said. 


YES 


MO 


N/A 


Shakes his head from side to side when he states 
his disagreement with something the client has said. 


YES 


NO 


N/A 


Tone of voice la compatible with the verbal content 
of hia responses. For example, when he says, "I 
understand how you feel about this problem, "his 
voice tone communicates an earnest "I really know how 
you feel," rather than a buainess-like“»Tl4w how 
you feel; I*ve seen many others who felt the same 
way; now, let's get on :<rlth the interview. 


YES 


NO 


N/A 


When he turns from a "leaser" topic to a more 
serious one, hia tone of voice becomes more concerned. 


YES 


NO 


N/A 


When he looks shocked or angry, his voice quality 
mirrors these feelings (e.g., his voice is agitated, 
louder, etc.). 


YES 


NO 


N/A 


When his remarks suggest a feeling of greater 
psychological closeness to the client, he moves 
physically closer to him. 


YES 


NO 


N/A 



8ca1« No. 3 



- 2 - 



14. 61v«f th« overall Impretsion of ''being hlmeelf" 

In the interview; doea not put on a profeaaional 
front or facade; ia not a pretei^er, a phony, 
a "glad -hander," or a "eon-nan« 



It 



IBS NO N/A 



Overall rating on Conaietenev of Connunication between Verbal and Non-Ver^aj 
Behavior: Considering the definition of thia diaenai^ and the^ specif ic beMviora 

observed in the interview, circle a nuaber on the following scale to indicate 
your overall rating of the counselor on Consistency of Cowaun ication between verbal 

and Non-Verbal Behavior , 

ioia.^6789 



Exhibits verbal 
and non-verbal 
behaviors 
which are 
widely 
discrepant. 
Presents an 
almost 
uniformly 
Incompatible 
set of 
"signals." 

Seems a 
complete 
"phony" in 
his 

communlc at ion 
with the 
client. 



Exhibits 


Exhibits 


Exhibits 


Shows no 


verbal and 


verbal and 


verbal 


discernible 


non-verbal 


non-verbal 


and non- 


discrepancy 


behaviors 


behaviors 


verbal 


between verbal 


which are 


which are 


behaviors 


and non-verbal 


frequently 


occasionally 


which are 


behaviors. 


incompatible. 


out of line 


nearly 


Exhibits facial 


Often gives 


with each 


always 


expressions, 


the 


other. 


compatible. 


eye movements, 


Impression 


However, his 


Sometimes, 


voice quality. 


that he 


behaviors 


although 


gestures, etc.. 


does not 


considered 


seldom. 


that are 


mean what 


as a whole 


he engages 


uniformly 


he is 


seem 


in non- 


compatible with 


saying. 


reasonably 


verbal 


his 


compatible. 


behaviors 
which 
suggest 
that he 
does not 
fully 
m<ian 
what he 
is saying. 


verbalisations • 




Gounaalor 

Data 



Seals No, 4: Perceptital Sanaltivlty 

Part of the counselor '• task is to listen and comprehend what the client is 
communicating. Client coinuunications vary from overt, simple verbal expressions 
to very subtle non-verbal comminieations which are expressed through changes in 
voice quality, facial expression, gestures, nervous mannerisms, and the like. 

Observation of Specific Behaviors ; The following are some of the behaviors from 
which Perceptual Sensitivity may be inferred. For each behavior: 

Circle "YES" If the behavior occurred in this interview. 

Circle '*N0" if the behavior should have occurred in this Interview but did not* 
Circle **N/A" (for "Not Applicable") if the behavior failed to occur because 
it was irrelevant to this interview. 




1. 


Listens carefully to what the client is saying. 


YES 


NO 


N/A 


2, 


Remembers details of what the client has said, rather 
than having to be corrected or refreshed on such 
matters later in the interview. 


YES 


SO 


N/A 


3. 


Behaves in a manner apparently consistent with the client's 
mood (e,g,, smiles when the client smiles, etc,). 


YES 


HO 


N/A 


4, 


Apparently tries to see things from the client's 
point of view. 


YES 


HO 


N/A 


5. 


Appears alert to the feelings which are expressed in 
the client's remarks. 


YES 


HO 


N/A 


6, 


Makes statements apparently intended to convey his 
understand ir^ of the client's feelings (or, states 
that he understands how the client feels). 


YES 


HO 


N/A 


7. 


Suggests how the client feels about an event which he 
(the client) has mentioned. 


YES 


NO 


N/A 


8. 


Seems able to perceive and sort out ambivalent and 
conflicting feelings on the part of the client. 


YES 


NO 


N/A 


9, 


Responds to negative as well «^s positive feelings of the 
client 1 does not "move away" from negative feelings* 


YES 


NO 


N/A 


10, 


Seems alert to problems or difficulties other than the 
one first mentioned by the client. 


YES 


NO 


N/A 


11. 

^ 12, 


Follows abrupt client shifts in topic and seems able to 
tie these into a common thread or theme. 


YES 


NO 


N/A 


Usually responds to the "core" of a long, confused, or 
ambivalent client statement. 


YES 


NO 


N/A 


13, 


Responds to subtle cues regarding client attitudes, goals, 
etc. 


YES 


NO 


N/A 


er|c** 


Apparently perceives non-verbal cues on the part of the 
client, such as posture, tone of voice, and facial expression. 


> YES 


HO 


N/A 



Fart of th% couniialor • tack it to littan and conprahand what tha cllant It 

®l^*“\co*«“icatiO!it vary from ovart, tlapla varbal axprattiont 
^4!^* non-varbal eo«amleationt which ara axprattad through changat In 
lea quality, facial axprattlon, gatturat, narvout mannarltnt, and tha Ilka» 

Specific Bahavlort ; Tha following ara toma of tha hahavlort fro« 
which ^rcapt^l Sanaltlvlty may ba Infarrad. For aach bahavlor: 

.2s bahavlor occurrad in thlt Intarvlaw. 

r4^!i! ahould hava occurrad In tbit Intarviaw but did not. 

(for Hot Appllcabla") If tha bahavlor fallad to occur bacauta 
It wat Irralavant to thlt Intarviaw. 



1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 
9 . 

10 , 

11 . 

12 . 

13 . 

14 . 

15 . 

16 . 
17 . 



lilttana carefully to what tha cllant It taylng. 

kamambart datailt of what tha cllant hat tald, rathar 
than having to ba corractad or rafrathad on tuch 
mattart latar in tha Intarviaw. 

kohavat In a mannar apparently contittant with tha cllant 'a 
■ood (a.g., tmllaa whan tha client tmllat, ate.). 

Apparantly tries to tee thingt from the client's 
point of view. 

^peart alert to the feelings which ara axprattad in 
the client's remarks. 

Makes statements apparently Intended to convey his 
u^arstandlng of the client's feelings (or, states 
that ha understands how the cllant feels). 

Suggests how the client feels about an event which he 
Ithe client) has mentioned. 

Seems able to perceive and sort out ambivalent and 
conflicting feelings on the part of the client. 

Responds to negative as well as positive feelings of the 
client j does not "move away*’ from negative feelings. 

Seems alert to problems or difficulties other than the 
one first mentioned by the client. 

Follows abrupt client shifts in topic and seems able to 
tie these Into a coomon thread or theme. 

Usually responds to the "core” of a long, confused, or 
ambivalent client statement. 

Responds to subtle cues regarding client attitudes, goals, 

G CO m 

Apparently perceives non-verbal cues on the part of the 
client, such as posture, tone of voice, and facial expression 

Calls attention to the client's facial expression. 



18 . 



u 

ERIC 



Phrases su^ries or Interpretations in tentative ways. 
Inviting client "feedback," ^ 

Times hls Interprr ations appropriately; avoids premature, 
defense -arousing Interpretations. 



YBS 


NO 


N/A 




NO 


N/A 


YES 


HO 


N/A 


YBS 


HO 


N/A 


YBS 


HO 


N/A 


YES 


HO 


N/A 


YES 


NO 


N/A 


YES 


HO 


N/A 


YES 


NO 


N/A 


YES 


NO 


N/A 


YES 


NO 


N/A 


YES 


NO 


N/A 


YES 


NO 


N/A 


• YES 


HO 


N/A 


YES 


NO 


N/A 


YES 


HO 


N/A 


YES 


NO 


N/A 


YES 


NO 


N/A 



• 2 • 



Seal* No. 4 






19* Uttf a Itval of voeabularjr (word difficulty) 

•inilar to that of the cliant* 

20. Oats tha "lingo” of tha cliant. For axanpla, if th* cliant 
uaaa tha tarm **Kac" for Maealaatar Oollaga» tha 
eounaalor alao uaaa **Kac". 0r» if tha eliant apaaka 

of baing "on cloud ninCf" tha eounaalor raaponda with 
aonathing lika **Whan you*ra on cloud nina • • •” 

21. Suppliaa a kay word or phraaa for which tha cliant ia 
unaueeaaafully groping. 

22. Uhan tha cliant appaara borad, uncoocamad, or 
otharwiaa "raaiatant" in tha intarviaw, tha 
eounaalor diaeuaaaa thla with him. 



rm 


■0 


R/A 


ns 


NO 


■/A 


TSS 


NO 


■/A 


TBS 


NO 


H/A 



Overall Ratlna on Percaptual Sanaltlvlty ; Ckmaidaring tha definition of thia 
dimanaion and the apacific bahaviora obaarved in tha intarviaw, circle a number 
on tha following acale to indicate your overall rating of tha eounaalor on 
Percaptual Sanaitivitv. 



1 : 

i 

1 

1 


1 : 


3 4 

1 

\ 

1 


5 6 

! 1 


7 8 

J L 


9 

1 

1 

» 


Hardly ever 


Receives 


Receives 


Receives 


Receives 


receives 


some 


of the 


most of 


all of 


all of 


overt client 


overt client 


the overt 


the overt 


the overt 


communicat ions , 


communications , 


communications , 


client 


communi- 


and never 


but none of the 


of the client. 


communi- 


cations of 


receives the 


subtle ones. 


and a few of 


cations. 


the client 


subtle ones. 






the subtle ones. 


and most 


and all or 










of the 


nearly all 










subtle 


of the sub 










ones. 


ones. 



o 



t«t«r 



Counf«lor. 

Pat#. 



Scale N0» 5: Involvcmant with Client 

One of the counselor* a aesete la hla ability to enter Into a close, spontaneous 
relationship with the client. There are two aaln aspects to this dlsMOslon of 
counseling: (a) the extent to which the counselor shows a genuine feeling of 

acceptance and caring for the client, and (b) the extent to which the counselor 
reveals himself frankly and openly as one human being to another. 

fibtap:at.lo n__of specific Behaviors : The following are some of the behaviors from 

which Involvement with Client nay be Inferred. For each behavior i 

Circle *'YES*' If the behavior occurred In this Interview. 

Circle '*N0“ If the behavior should have occurred In this Interview but did not. 
Circle *'N/A” (for **Not Applicable'') if the behavior failed to occur because 
It was Irrelevant to this interview. 



1. 


Uses the client's first name. 


YES 


MO 


as 


2. 


Usually looks at the client. 


TES 


190 


N/A 


3. 


Focuses his attention on the client, rather than 
appearing detached, disinterested, or preoccupied. 


YES 


NO 


N/A 


4. 


Has an open and receptive facial expression. 


YES 


NO 


N/A 


5. 


Has a pleasant manner. 


YSS 


NO 


N/A 


6. 


Has an animated, overtly responsive manner in 
the Interview; not "deadpan." 


YES 


NO 


N/A 


7. 


Seems at ease with the client; has a relaxed 
posture; does not appear tense or exhibit nervous 
mannerisms. 


YES 


NO 


N/A 


8. 


Smiles as an expression of cordiality toward the 
client. 


YES 


MO 


N/A 


9. 


Smiles when the client makes a humorous remark. 


YES 


NO 


N/A 


10. 


Leans toward the client apparently as an expression 
of interest. 


YES 


MO 


N/A 


11. 


Makes casual physical contact with the client as an 
expression of affection. 


YES 


NO 


N/A 


12. 

) 


Shows consideration for the client's physical 
comfort (e.g«, asks whether client Is physically 
comfortable, offers a more comfortable chair, 
adjusts window for client's comfort, hangs up 
client's coat, etc.). 


YES 


NO 


N/A 


13. 


Offers the client a piece of candy or gum or other 
favor. 


YES 


NO 


N/A 


14. 

o 

ERIC 


Expresses his willingness to help the client If 
it Is possible. 


YES 


NO 


N/A 



r«l«tlofiahlp with the client. There ere two aein Mpeete to thle dlaeneion of 
couneellng: (e) the extent to which the couneelor ebowe e genuine feeling of 

ecceptence end caring for the client, and (b) the extent to which the couneelor 
reveals himself frankly and openly as one human being to another* 

Observatio n of specific Behaviors : The following are some of the behaviors from 

which Involvement with Client may be inferred* For each behsviori 

Circle “YES” if the behavior occurred in this interview* 

Circle if the behavior should have occurred in this intervi ut did not 
Circle *'H/A” (for '*!lot Applicable") if the behavior failed to occur because 
It was Irrelevant to this interview* 



1. 


Uses the client's first name* 


TBS 


NO 


N/A 


2. 


Usually looks at the client* 


TBS 


NO 


N/A 


3. 


Focuses his attention on the client, rather than 
appearing detached, disinterested, or preoccupied* 


YES 


NO 


N/A 


4. 


Has an open and receptive facial expression. 


YES 


NO 


N/A 


5. 


Has a pleasant manner* 


YES 


NO 


N/A 


6. 


Has an animated, overtly responsive manner In 
the interview; not "deadpan," 


YES 


NO 


N/A 


7* 


Seems at ease with the client; has a relaxed 
posture; does not appear tense or exhibit nervous 
mannerisms. 


YES 


MO 


N/A 


8. 


Smiles as an expression of cordiality toward the 
client. 


YES 


NO 


N/A 


9. 


Smiles when the client makes a humorous remark* 


YES 


NO 


M/A 


10. 


Leans toward the client apparently as an expression 
of interest* 


YES 


NO 


N/A 


11. 


Makes casual physical contact with the client as an 
expression of affection. 


YES 


NO 


N/A 


12* 


Shows consideration for the client's physical 
comfort (e*g«, asks whether client is physically 
comfortable, offers a more comfortable chair, 
adjusts window for client's comfort, hangs up 
client's coat, etc*). 


YES 


NO 


N/A 


13* 


Offers the client a piece of candy or gum or other 
favor* 


YES 


NO 


N/A 


14. 


Expresses his willingness to help the client if 
it is possible* 


YES 


NO 


M/A 


15. 


Talks enthusiastically about the client's hobbies 
or special interests* 


YES 


NO 


N/A 


16. 


Asks the client how he feels about being 
interviewed * 


YES 


MO 


N/A 


17. 


Asks how the client feels toward him* 


YES 


MO 


N/A 


18. 


Discusses the feelings which the client has toward 
him. 


YES 


MO 


M/A 



. 2 - Scale No* 5 



19. 


When the client directs negative feelings toward 
him, the counselor invites a frank discussion of 
these feelings. 


YES 


MO 


N/A 


20. 


Tells the client how he feels toward him. 


YES 


NO 


N/A 


21, 


Verbally expresses his sympathy for the client,. 


YES 


NO 


N/A 


22, 


Deals directly and openly with a client request to 
know his opinion, value, attitude or feeling. 


YES 


NO 


N/A 


23, 


When a client statement obviously challenges one of 
the counselor's cherished values, he talks about 
this with the client. 


YES 


NO 


N/A 


24. 


Voluntarily states his opinion or feeling about 
something the client has said. 


YES 


NO 


N/A 


25. 


Talks about himself in the interview (his own 
experiences, attitudes, values, Interests, etc.) 
in response to a client need. 


YES 


NO 


N/A 


26. 


Hakes statements critical of himself to the client. 


YES 


MO 


N/A 



Qyerftll Rating on lo volvement with Client ; Considering the definition of this 
d^nsion and the specific behaviors observed in the interview, circle a number on 
the following scale to indicate your overaL 1 rating of the counselor on 



1 


2 3 4 

1 I 


Gives no 


Usually quite 


evidence 


remote in the 


of genuine 


relationship. 


acceptance 


although 


or caring 


there are 


for the 


a few 


client. 


indications 


Almost 


that he 


uniformly 


would like 


distant. 


to get 


guarded. 


"closer" 


and overly 


to the 


"professional" 


client. 



8 



Usually 

communicates 

his 

acceptance 
and caring 
for the 
client, but 
at times 
seems some- 
what distant 
and Impersonal, 
Shares himself 
openly with the 
client on some 
occasions, but 
at other times 
tries to appear 
neutral or 
noncomml tta 1 • 



Coimnunlcates 
his acceptance 
and caring for 
the client at 
all times. 
Shows some 
reluctance 
to share his 
personal 
feelings, 
attitudes, 
or opinions 
in response 
to 6 client 
need. 



Communicates 
his accept- 
ance and 
caring for 
the client 
at all 
times, 
Reveals 
himself 
quite 
frankly 
and openly 
in response 
to a client 
need. 



er|c 




Counselor 
Date 



Overall Retina of the Intervlev t Please circle a number on the following scale 
to Indicate your general Impression of the interview. Make this evaluation a . ter ^ 
performing the ratings on the five dimensions. 



1 


2 


3 4 


5 


6 


7 


8 


9 


1 


1 


i 1 


1 


1 


1 


_i 


1 


Very 




Weak^ . 


Fair 




Good 




Excellent 



Poor 



ERIC 



SIMORT 



^ typ«i of counoollng practlcum progrosjs were compared uaing a population of 

M ^ P«ctic«i tr..tn.nto. Group A rte.lv«] . 
•UD«j4ind^J.m! u practicum eonaliicicg of alxty hours of 

s "** '““'•“‘'•‘••J l“t» the final three isonths of 

program. Group B recelvad the same <t£mber of hours 

month period. Supervising staff and foethods of 
instruction were identical for the two groups# 

**“*““ts were measured using a set of 
Sf developed to Mature five theoretically relevant constructs 

sLi^«^„S^“!!*k*' •* performance In the Interview. These 

of ^"**'J"dge reliabilities on the order 

tet;rvie^ wire » ISi^idirof 

«T!! "•** *° evaluate slxtean m.m. sound motion picture 

^^th g“™!““® interviews done on completion of practlcum treatments 

^*-'*^*^ ****^^*^e of verlance tests on all five constructs and overall intervfM. 

trii^rdlfn'** run for the total group of thirty counselors. 

It iinit '***’'•“ ““ “y •=''# variables. 

arouD nerfo^^il to reject the null hypothesis. The distributed treatment 
group performed as well on these measures as did the concentrated group. 

behiil^ Se*!!! 1 “*® Involved the analysis of the non-verbal Interview 

iS^ini^ ootagorlea of such behavior were 

b^ii hJih .!h !!! “*=*«°'^** found to discriminate significantly 

couMelors^ce^Dh^lEri oounselOTs. Findings suggested that high rated 

!J? vhlle low rated counselors tended 

io i^aJiMir ?if„ ?/!"“ ®'°“ ‘’•^y “oveMnts and to nod and Mil# 

• greater extent than high rated counaelorse 



